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LIGHT EMITTING DEVICE PROJECTION METHODS AND SYSTEMS 

[0001] The present application is a continuation-in-part of U.S. Patent 
Application Ser. No. 10/419321, filed April 19, 2003, entitled "Projector Having 
Scanning Optics", inventors Winthrop D. Childers, et. al. The present application 
5 is also a continuation-in-part of U.S. Patent Application Ser. No. 10/349047, filed 
January 21, 2003, entitled "Projector Having Alignment Optics and Electronics", 
inventor Winthrop D. Childers, which is a continuation-in-part of U.S. Patent 
Application Ser. No. 10/309425, filed December 3, 2002, entitled "Projector 
Having Alignment Optics and Electronics", inventor Winthrop D. Childers, and a 
10 continuation-in-part application of U.S. Patent Application Ser. No. 10/138765, 
entitled "Projector Having Scanning Optics", by Winthrop Childers, filed on May 3, 
2002. 

BACKGROUND OF THE INVENTION 

15 

[0002] Conventional digital projectors are generally devices that integrate light 
sources, light modulators, optics systems, electronics, and/or displays for 
projecting images, using data signals from computers or video devices, onto 
walls or screens, for large-image viewing. During a frame (whether a standard 
20 NTSC frame lasting approximately 1/60 th of a second or a frame of some other 
duration), light emitted by the light source is modulated and then projected onto 
the viewing surface at designated pixel locations to form the image being 
displayed. Conventional projectors have limitations depending upon their 
architecture and implementation. 

25 [0003] For example some systems, such as the Texas Instruments DLP 

based systems, utilize a color wheel in series with a micro-mirror light modulator. 
Issues that may arise with the DLP system include sequential color artifacts, cost 
of the micro-mirror, and lost light due to the color wheel. 

[0004] Other systems such as LCD projectors split the light using dichroics 
30 into primary colors, and modulate each color with an LCD panel before 

recombining the light. While these systems are often more light-efficient than 
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color wheels, there is still light lost due to polarization. Also, the optics tend to be 
complicated and expensive. 

SUMMARY OF THE INVENTION 

5 

[0005] Some embodiments of the invention provide a projection system 
including a frame buffer block, a reordering block, a redundancy separation block, 
an array of light emitting devices, and optics. The frame buffer block stores pixel 
data specifying desired pixel values for pixel locations in an image. The 

10 reordering block reads selected pixel data from the frame buffer block and 

assigns the selected pixel data to corresponding light emitting devices in an array 
of light emitting devices; the pixel data is selected according to a mapping that 
maps the array of light emitting devices to target pixel locations toward which the 
light emitting devices will be directed, such that each pixel location is a light 

15 emitting device target at least twice per frame and each light emitting device is 
directed toward at least two pixel locations per frame. The redundancy 
separation block receives from the reordering block pixel data and corresponding 
light emitting device assignments specifying the total expected emitted light for 
each assigned light emitting device during a frame, and the redundancy 

20 separation block allocates those totals among the subframes of the frame. The 
array of light emitting devices is directed according to the signals provided by the 
frame buffer block, the reordering block, and the redundancy separation block. 
Optics guide light from the light emitting devices toward the pixel locations. 

[0006] Other aspects of the present invention will become more fully apparent 
25 through the following description. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0007] To illustrate the manner in which the advantages and features of the 
30 invention are obtained, a more particular description of the invention will be given 
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with reference to the attached drawings. These drawings only illustrate selected 
aspects of the invention and thus do not fully determine the invention's scope. 

[0008] FIG. 1 is a flow chart of a projection method according to at least one 
embodiment of the present invention; 

5 [0009] FIG. 2 is a flow chart further illustrating some steps that may be used 
by the method(s) shown in Figure 1 ; 

[0010] FIG. 3 is a diagram illustrating a projection system according to at least 
one embodiment of the present invention; 

[0011] FIG. 4 is a diagram illustrating a projection system, which further 
10 illustrates an embodiment of the system(s) shown in Figure 3; 

[0012] FIG. 5 is a diagram illustrating light emitting devices in a superpixel in a 
projection system according to an embodiment of the present invention; 

[0013] FIG. 6 is a diagram illustrating projection system component blocks 
according to at least one embodiment of the present invention; 

15 [0014] FIG. 7 is a diagram illustrating projection system component blocks in 
one color's data path, which further illustrates an embodiment of the system(s) 
shown in Figure 6; 

[0015] FIG. 8 is a diagram illustrating target pixel locations in a display 
according to an embodiment of the present invention; 

20 [0016] FIG. 9 is a diagram illustrating a display with details of a mapping that 
maps an array of light emitting devices to target pixel locations in the display 
according to an embodiment of the present invention such as one for an SVGA 
system with four subframes and horizontal swaths; 

[0 017] FIG. 10 is a diagram illustrating a display with details of a mapping that 
25 maps an array of light emitting devices to target pixel locations in the display 
according to an embodiment of the present invention such as one for an SVGA 
system with four subframes and diagonal swaths; 

[0018] FIG. 11 is a diagram illustrating a display with details of a mapping that 
maps an array of light emitting devices to target pixel locations in the display 
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according to an embodiment of the present invention such as one for a UXGA 
system with two subframes and diagonal swaths; 

[0019] FIG. 12 is a table illustrating details of a mapping that maps an array of 
light emitting devices to target pixel locations in a display according to an 
5 embodiment of the present invention such as one for an SVGA system with ten 
subframes and stripes from interleaved light emitting devices; and 

[0020] FIG. 13 is a table illustrating details of a mapping that maps an array of 
light emitting devices to target pixel locations in a display according to an 
embodiment of the present invention such as one for a UXGA system with ten 
10 subframes and stripes from interleaved light emitting devices. 

DETAILED DESCRIPTION 

[0021] Reference will now be made to exemplary embodiments such as those 
15 illustrated in the drawings, and specific language will be used herein to describe 
the same. But alterations and further modifications of the inventive features 
illustrated herein, and additional applications of the principles of the inventions as 
illustrated herein, which would occur to one skilled in the relevant art(s) and 
having possession of this disclosure, should be considered within the scope of 
20 the invention. 

[0022] In describing the invention, the meaning of important terms is clarified, 
so the claims must be read with careful attention to these clarifications. Specific 
examples are given to illustrate aspects of the invention, but those of skill in the 
relevant art(s) will understand that other examples may also fall within the 

25 meaning of the terms used, and within the scope of one or more claims. Words 
used herein do not necessarily have the same meaning they have in everyday 
usage. Terms may be defined, either explicitly or implicitly, here in the Detailed 
Description and/or elsewhere in the application file. It is not necessary for every 
means or aspect identified in a given definition or example to be present or to be 

30 utilized in every embodiment of the invention. 
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Projection Methods 

[0023] Figure 1 is a flow chart of projection methods 100 according to the 
present invention. The invention provides projection methods for directing a 
collection of individual light generators or individually addressable light sources or 
5 other "light emitting devices" toward pixel locations during a frame to make an 
image having pixels that are illuminated at least in part by light emitted from the 
directed light emitting devices. The light emitting devices 306 (Figure 3) may be 
individually addressable devices such as light emitting diodes or lasers or other 
solid state devices that can cast small spots of light upon a viewing screen. A 

10 light emitting diode is a particular example of an individually controllable light 
emitting device. Before reaching the screen, light from a particular light emitting 
device will generally tend to pass through various optics before reaching the 
viewing surface. In the present invention, this includes scanning optics for 
causing the light to scan across the screen to address various pixel locations on 

15 the screen. 

[0024] The mere fact that a particular light emitting device in a projection 
system does not operate according to the described invention would not place 
the projection system and/or its operation outside the claimed invention. For 
instance, infringement is not avoided by simply adding one undirected LED to an 
20 array of LEDs that is otherwise directed as described herein. The invention is 
embodied if there is any collection of LEDs and/or other light emitting devices 
within the system or method in question that direct light as claimed and if the 
other claim limitations are met. 

[0025] Likewise, the frame may be an NTSC frame lasting approximately 
25 1/60 th of a second, or it may have some other frame duration. Pixel locations 804 
(Figure 8) are locations on a display 802 (Figure 8) screen, and/or another 
viewing surface such as a wall. 

[0026] The illustrated method 100 includes directing steps 102, 104. During a 
subframe of the frame, step 102 directs at least one of the light emitting devices 
30 toward a pixel location. During another subframe of the same frame, step 104 
directs at least one of the light emitting devices toward the same pixel location, 
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thereby making that pixel location a light emitting device target at least twice 
during that frame. As indicated by flow chart path 106, step 104 may be repeated 
in some methods of the invention. 

[0027] When we say that a light emitting device is directed toward the same 
5 pixel location on a viewing surface, it does not necessarily mean the exact same 
location on the viewing surface, at least not in every embodiment. The light 
emitting device may be directed to a location that overlaps with the pixel or is in 
close proximity (within a distance of one pixel) to the pixel. Another way to say 
this is that the location is within a sub-pixel vicinity of the pixel. In practical 

10 systems, alignment of light emitting devices from one pass of the scanning optics 
(to be discussed shortly) to the next tends to be imperfect. Also, there may be 
reason to shift data to enhance resolution from one frame to the next or one 
subframe to the next. For instance, each subframe may have SVGA resolution 
(800 X 600) but four subframes in sequence may define UXGA resolution (1600 

15 X 1 200) with such shifting. 

[0028] When a light emitting device addresses a pixel location, it is not 
centered at a particular point but actually sweeps out a very small area, since the 
beam hitting the viewing surface is constantly moving. We can refer to the 
centroid (like a center of mass calculation on the energy dose) of the spot 
20 formed. A spot location in a sub-pixel vicinity of a pixel location would be a spot 
that has a centroid that is less than the center to center distance between two 
pixels from the targeted pixel. 

[0029] When we refer to a subframe, we are referring to a portion of the frame 
period during which a collection of light emitting devices overwrites at least a 

25 portion of an illuminated viewing surface with at least one color. Subframes are 
generally sequential - a frame starts with subframe 1 , subframe 2, etc., with 
minimal temporal overlap between subframes. During a particular subframe, all 
the primary colors are typically utilized (defining the difference between a 
subframe and a "color subframe"). Typically red, green, and blue spots are 

30 generated simultaneously on the illuminated viewing surface. 
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[003 0] The "illuminated viewing surface" refers to the actual area of the 
viewing surface that the projector system illuminates. This is, of course, affected 
by the zoom, the distance between the projector and the viewing surface, and the 
format of the incoming video signal. In the special case of an RPTV (rear 
5 projection television) the zoom and distance are fixed. 

[0031] A light emitting device can be "directed" toward a pixel location 
regardless of whether the light emitting device emits light. That is, in determining 
whether a given light emitting device is directed toward a given location one is not 
limited to observing whether light from the light emitting device actually reaches 
10 the location. For instance, a weakened or burned-out LED may be directed 
toward a specified pixel location even if no light from the LED reaches the 
targeted location. 

[0032] When we say that a light emitting device is directed toward a given 
pixel location, it means that the intervening optics is configured to cause light 

15 from that light emitting device to form a spot on the viewing surface at the 

particular pixel location in the event that the light emitting device is outputting 
light. As indicated before, of course, the "same pixel location" is inexact and 
could be up to one pixel away from the same location. Pixel locations on the 
viewing surface or screen are locations defined by the projection system and 

20 each is generally addressed by forming spots from the light emitting devices. 

Addressing a pixel location with a light emitting device generally means the same 
thing as directing the light emitting device to the pixel location and would mean 
forming a spot at the pixel location provided that the light emitting device is in an 
ON state and/or is outputting light, and the optics are working. 

25 [0033] One approach to understanding the invention is to consider mappings 
from the light emitting devices to the pixel locations. Mappings are illustrated in 
Figures 8 to 13 and in Figure 2, for example. In some embodiments, each light 
emitting device in the collection of light emitting devices with which the invention 
is concerned are directed during the same frame toward at least two different 

30 pixel locations, as noted in step 202 in Figure 2. That is, a given light emitting 
device is mapped to at least two pixel locations per frame. In some 



embodiments, each pixel location with which the invention is concerned is the 
target during one frame of at least two different light emitting devices of a given 
color, as noted in step 204. That is, at least two light emitting devices of the color 
in question are mapped to a given pixel location per frame. Such one-to-many, 
5 many-to-one, and many-to-many mappings of light emitting devices to pixel 
locations may be done in a serial manner across subframes and/or in a parallel 
manner during a given subframe in various embodiments of the invention. 

[0034] As discussed and illustrated at least in connection with Figures 8 
through 13, mappings may also preserve adjacency or not. In some 

10 embodiments, adjacent light emitting devices are mapped 206 in swaths to 
adjacent pixel locations, whereas in some other embodiments adjacent light 
emitting devices are mapped 208 in stripes to nonadjacent pixel locations. 
Stripes and swaths may be mixed in some embodiments. Stripes and swaths 
may be horizontal, vertical, or diagonal, and they may be overlapping or non- 

15 overlapping. Mappings that do not preserve adjacency may do so with patterns 
other than regular horizontal stripes, such as by spreading in both vertical and 
horizontal axes instead of spreading only in parallel lines. 

[003 5] Thus, in some embodiments pixel locations are light emitting device 
targets more than twice during the frame. In some embodiments at least two 

20 different light emitting devices of a given color are directed toward the same pixel 
location during the frame. In some embodiments light emitting devices are 
directed toward pixel locations in swaths such that adjacent light emitting devices 
are directed at adjacent pixel locations during a subframe. In some embodiments 
light emitting devices are directed toward pixel locations in stripes such that 

25 adjacent light emitting devices are directed at nonadjacent pixel locations during 
a subframe. 

[0036] In some embodiments 210 the subframes are of equal duration; in 
others they are not. Unless otherwise indicated, however, substantially equal 
length subframes are assumed in the specific examples provided herein. 
30 Subframes of a frame have substantially equal length if the longest subframe is 
no more than 1 .5 times the length of the shortest subframe. 
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[0037] In some embodiments the total illumination reaching a pixel location 
from the light emitting devices during the frame is divided 212 substantially 
equally between all subframes of the frame. For instance, if there are two 
subframes and the total energy or other illumination measure reaching the pixel 
5 location is denoted by x, and if t denotes a tolerance, then each subframe 
receives a value that lies within x/2 plus or minus t as its portion of the total 
illumination. That is, the illumination is divided about equally between the 
subframes. Suitable tolerances t can be determined by those of skill in the art; 
suggested starting values are to set t equal to 1 5%, 1 0%, or 5% of the value x/n, 

10 where x is the total illumination intended to reach a pixel location during the 

frame, and n is the number of equal-length subframes of the frame. An approach 
that divides illumination about equally between subframes may also be described 
as spreading the most significant bits (MSBs) of the illumination over multiple 
light emitting device passes. An alternative is to weight one or more subframes 

1 5 more heavily than the other subframe(s) so that one or more subframes provides 
(or attempts to provide - light emitting devices may be weak and/or missing) 
substantially more illumination than the other subframe(s) in the given frame. 

[0038] In some embodiments, blanking intervals are included 214 between 
light emitting device activations. That is, the light emitting devices do not 
20 continuously emit light even if they are directed at fully illuminated pixels. This is 
further illustrated and discussed in connection with Figures 9 to 1 1. 

[0039] The steps and other characteristics described herein may be combined 
in various ways to form embodiments of the invention. In methods of the 
invention, steps may be omitted, repeated, renamed, supplemented, performed in 
25 serial or parallel, and/or grouped differently, except as required by the claims and 
to provide an operable embodiment. In particular, not every step illustrated in 
Figure 2 need be performed in a given method according to the invention. 

[0040] By way of example, one projection method according to the invention 
includes the steps of: during a subframe of a frame directing 102 a light emitting 
30 device toward a pixel location; and during another subframe of the same frame 
directing 104 a light emitting device toward the same pixel location, thereby 
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making that pixel location a light emitting device target at least twice during that 
frame, wherein each light emitting device in a collection of light emitting devices 
is directed 202 during the same frame toward at least two different pixel 
locations, regardless of whether the light emitting device emits light, and light 
5 emitting devices are directed 206 toward pixel locations in swaths such that 
adjacent light emitting devices are directed at adjacent pixel locations during a 
subframe. In one such embodiment, light emitting devices are directed toward 
pixel locations during each of at least four subframes of the frame, so path 106 is 
followed at least twice. In one, each pixel location is 204 a target of at least two 
10 different light emitting devices of a given color during the frame. In one, the 
swaths are diagonal such that a row of light emitting devices is directed at a 
selection of pixel rows which varies linearly during a subframe. 

[0041] As another example, one projection method according to the invention 
includes the steps of: during a subframe of a frame directing 102 a light emitting 

1 5 device toward a pixel location; and during another subframe of the same frame 
directing 104 a light emitting device toward the same pixel location, thereby 
making 204 that pixel location a light emitting device target at least twice during 
that frame, wherein each light emitting device in a collection of light emitting 
devices is directed 202 during the same frame toward at least two different pixel 

20 locations, regardless of whether the light emitting device emits light, and light 
emitting devices are directed 208 toward pixel locations in stripes such that 
adjacent light emitting devices are directed at nonadjacent pixel locations during 
a subframe. In one such embodiment, light emitting devices are directed 102, 
104 toward pixel locations during each of at least ten subframes of the frame, so 

25 path 106 is followed at least eight times. 

[0042] Even though particular embodiments and uses of the present invention 
are expressly illustrated and described individually herein, it will be appreciated 
that discussion of one type of embodiment and its uses also generally extends to 
other embodiment types and their uses. For instance, the foregoing description 
30 of the invention's methods also helps describe the structures and operation of the 
invention's systems and system components, and vice versa. 
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Projection System Components and Systems 

[0043] Figure 3 is a diagram illustrating a projection system 300 of the present 
invention. In one embodiment, an RGB input video signal 302 includes color 
5 frames, such as frames at the rate of approximately 60 frames per second. The 
invention assists in generating an image from a given frame of data having a 
given resolution. The image may be generated from color maps in which each 
color map has all pixels addressed with a given color, such as red, green and 
blue. By dividing the color maps into temporally sequential subframes for a given 
10 primary color, the invention may reduce errors or visual artifacts from missing or 
weak LEDs, for instance. Flicker may also be reduced by having multiple 
subframes. 

[0044] System control electronics 304 may manipulate and/or build on the 
input video signal to implement the inventive methods. The control electronics 
1 5 304 may be implemented, manufactured, and/or sold in components. To the 
extent that hardware, software, and firmware implementations are deemed 
partially or fully interchangeable at the time in question by one of skill in the art, 
they may be utilized in embodying the invention even though the specific 
examples discussed here are implemented differently. 

20 [0045] In one embodiment, a color mapper block 602 (Figure 6) receives 

NTSC RGB information 302 and converts that information into the light emitting 
device RGB color space. The light emitting device RGB color space primaries 
depend on the wavelengths of the LEDs or other light emitting devices 306. 

[0046] In one embodiment, a projection system component within the control 
25 electronics includes a frame buffer block 604 (Figure 6) which stores pixel data 
specifying desired pixel values for pixel locations in an image; and a reordering 
block 606 which reads selected pixel data from the frame buffer block and 
assigns the selected pixel data to corresponding light emitting devices in an array 
of light emitting devices. The pixel data may be selected according to a mapping 
30 that maps the array of light emitting devices to target pixel locations toward which 
the light emitting devices will be directed. For instance, the mapping may be 
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such that each pixel location is a target of at least two light emitting devices in 
each frame and each light emitting device is directed toward at least two pixel 
locations in each frame. 

[0047] In one embodiment, the frame buffer block stores at least two frames of 
5 pixel data. Data is read from the frame buffer repeatedly to support multiple 
subframes, that is, multiple passes across a pixel location. One implementation 
of the frame buffer block 604 includes an external SRAM 702 (Figure 7). This 
particular implementation supports 800x600 pixels/frame x 4 bytes/pixel x 2 
frames = 3.67 Mbytes of storage. R, G, B values are stored in adjacent bytes, 32 
10 bits/pixel. Other implementations of the frame buffer are also possible within the 
scope of the invention. 

[0048] In one embodiment, the reordering block grabs what is needed from 
the frame buffer in order to optically address what is required for light emitting 
device sequencing on an array of light emitting devices, such as a 4 x 120 array 

1 5 of LEDs. One implementation of the reordering block 606 includes two internal 
SRAMs 706 and logic circuitry 708 (Figure 7). In this particular implementation 
each block SRAM 706 supports 16 bits/color/write x 2 writes/burst width x 120 
high x 4 swing = 1920 bytes of storage. The logic 708 includes thirty-two 8:1 
multiplexers, so that from 8 bytes it selects 4 bytes for 4 adjacent LEDs. Other 

20 implementations of the reordering block are also possible within the scope of the 
invention. 

[0049] In some embodiments, a projection system component includes a 
redundancy separation block 608 which receives from the reordering block pixel 
data and corresponding light emitting device assignments specifying the total 

25 expected emitted light for each assigned light emitting device during a frame. 
The redundancy separation block allocates those light emitting device totals 
among the subframes of the frame. For instance, in some embodiments the 
redundancy separation block allocates the energy contribution for the LEDs that 
address a pixel during a particular frame such that each of four subframes 

30 receives approximately equal energy; some may receive slightly more or less to 
correspond with the least significant bits of the energy. 
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[0050] The redundancy separation block may use table lookup to allocate 
intensity for multiple light emitting devices and passes for each pixel location. 
One implementation of the redundancy separation block 608 includes four lookup 
tables in internal SRAMs 712 (Figure 7). In this particular implementation each 
5 SRAM 71 2 supports 2 Kbytes of storage. Other implementations of the 

redundancy separation block are also possible within the scope of the invention. 

[0051] In some embodiments the projection system 300 includes light emitting 
device strength compensation 610 circuitry and light emitting device control 612 
circuitry. One implementation includes 2 block SRAMs 714 (123x4 LEDs * 16 

10 bits/LED = 984 bytes), four multipliers 716 and a set of pulse width modulation 
down counters 718, as shown in Figure 7. In this particular implementation, the 
multipliers are implemented with logic embedded as shown, and there are 492 
down counters to support pulse width modulation of each LED, in a configuration 
4 LEDs wide and 123 LEDs high. Other implementations of the circuits 610, 612 

1 5 are also possible within the scope of the invention. 

[0052] Note that Figure 7 details a single color's data path, e.g., the red light 
emitting device data path, in a system component having three colors; the green 
data path and the blue data path are generally duplicates of the illustrated red 
data path. A vertical pass signal line 710 connects to all three data paths, as 
20 does signal line 704 from the frame buffer SRAM 702. The invention may also be 
used in monochrome systems, and in systems using color spaces other than 
RGB. 

[0053] As indicated, in some embodiments the invention provides a projection 
system component wherein the allocation of a light emitting device total is partly 

25 determined by pulse width modulation of the light emitting device. In some 

embodiments the allocation of a light emitting device total is partly determined by 
intensity of the light emitting device. In some, the allocation of light emitting 
device totals specifies for each light emitting device that the energy emitted from 
that light emitting device will be approximately equal during each subframe, 

30 whereas in others some subframes are allocated substantially more energy than 
other subframes. 
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[0054] Different embodiments may omit, repeat, regroup, supplement, or 
rearrange the blocks and components illustrated, provided the system overall is 
operable and conforms to at least one claim. As an example, the invention 
provides a projection system 300 like that shown in Figure 4 including: control 
5 electronics 304 having a frame buffer block which stores pixel data specifying 
desired pixel values for pixel locations in an image; a reordering block which 
reads selected pixel data from the frame buffer block and assigns the selected 
pixel data to corresponding light emitting devices in an array of light emitting 
devices, the pixel data being selected according to a mapping that maps the 

10 array of light emitting devices to target pixel locations toward which the light 
emitting devices will be directed, such that each pixel location is a light emitting 
device target at least twice per frame and each light emitting device is directed 
toward at least two pixel locations per frame; and a redundancy separation block 
which receives from the reordering block pixel data and corresponding light 

1 5 emitting device assignments specifying the total expected emitted light for each 
assigned light emitting device during a frame, and the redundancy separation 
block allocates those totals among the subframes of the frame. 

[0055] The system 300 further includes an array of light emitting devices 306 
directed according to the signals provided by the frame buffer block, the 
20 reordering block, and the redundancy separation block; in the embodiment 
illustrated in Figure 4, these include red light emitting devices 402, green light 
* emitting devices 404, and blue light emitting devices 406. Suitable light emitting 
devices include light emitting diodes (LEDs), semiconductor lasers, and/or 
vertical cavity surface emitting lasers, for example. 

25 [0056] If the projection system's array of light emitting devices includes red 

light emitting devices, green light emitting devices, and blue light emitting devices 
which define an RGB light emitting device color space, then the system's 
colormapper block 602 converts input data (such as RGB data or YCbCr data) 
into the RGB light emitting device color space from another color space. For 

30 instance, in some embodiments the colormapper block converts NTSC RGB data 
into the RGB light emitting device color space. In other embodiments, the system 
utilizes more than three color light emitting devices such as RGBCY (red, green 
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blue, cyan, and yellow) and would have a colormapper adapted for this color 
space. 

[0057] In some embodiments, the area of pixel locations (possibly but not 
necessarily every pixel location with shifting between projected spots an option 
5 between subframes) are addressed with all primary colors during a subframe. 
For a monochrome projector there would be only one primary. Some projectors 
use RGB, but others may use four, five, or more primaries to enhance the color 
space. 

[0058] Some embodiments of the system 300 include optics for guiding light 
10 from the light emitting devices toward the pixel locations. Light from LEDs is 

typically collimated and concentrated so it can be passed through scanning optics 
that cause the resultant light emitting device outputs to scan on two axes through 
projection optics and onto a viewing screen. 

[0059] In some embodiments the optics include concentrator optics 408, 
15 horizontal scanning optics 308, vertical scanning optics 310, and projection optics 
312. Scanning optics may be implemented using rotating polygonal mirrors, such 
as polygonal mirrors 410 and 412 in Figure 4. The optics may include one 
rotating polygonal mirror for vertical control of light emitted from light emitting 
devices and another rotating polygonal mirror for horizontal control of light 
20 emitted from light emitting devices. 

[0060] In an alternative embodiment, the vertical (or horizontal) scanning can 
be induced by a tilting mirror such a mirror that is programmably tilted using a 
galvanometer. In some embodiments the light emitting devices are turned off 
during blanking periods that correspond to vertices of the rotating polygonal 
25 mirror(s), thereby allowing for galvanometer mirror movement and settling. Other 
implementations of system optics may also be used, such as other types of optics 
for inducing the vertical and/or the horizontal scanning. 

[0061] The projection system may further include a screen or other display 
802 (Figure 8) having pixel locations 804 toward which the light emitting devices 
30 are directed. 
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[0062] Some embodiments employ one or more superpixels such as the one 
illustrated in Figure 5. A superpixel 500 array of light signals is generated and 
scanned across the viewing surface 802. Figure 5 depicts red, green, and blue 
light emitting devices. Each colored light emitting device 502 is individually 
5 addressable by the control electronics 304. The light emitting devices directed 
toward a pixel location are turned on and off to help determine the color intensity 
at that pixel location. The superpixel may be concentrated in a small area such 
as area 806 shown in Figure 8, or it may be widely dispersed across the screen 
802. 

10 

Additional Examples 

[00 63] Figures 8 through 13 illustrate mappings according to the invention 
between light emitting devices and the pixel locations targeted by the light 
emitting devices. However, embodiments of the invention are not limited to these 
15 specific examples, and a particular embodiment does not necessarily conform to 
any, to some, or to all of these examples. 

[0064] One of the embodiments illustrated by Figure 8 has the following 
detailed characteristics: NTSC frame rate of approximately 60 frames per 
second, which is about 16.67 milliseconds per frame; screen 802 resolution of 

20 SVGA or 800 horizontal by 600 vertical pixel locations 804 in an array; LEDs as 
light emitting devices with 480 LEDs each for R, G, and B, arranged in an 8 by 60 
array for each color, in a 24 by 60 array overall for RGB; rotating mirrors for 
horizontal and vertical control, with ten facets per mirror, providing 72 degrees of 
displacement; in a single frame 20 horizontal passes are made, covering the 

25 screen twice; the horizontal mirror spins at 7200 RPM (120 frames per second), 
and the vertical mirror spins at 720 RPM. Thus, in this embodiment during each 
color frame there are two facets per vertical mirror 412 and 20 facets (two 
revolutions) per horizontal mirror 410, as indicated in Figure 8 by the ten 
horizontal nonoverlapping swaths. Each subframe is defined by the complete 

30 coverage of the screen (viewing area) so there are two subframes per frame in 
this example. Note that in this example the swaths in Fig. 8 are shown as 



horizontal for simplicity but they would actually slope in a manner like that 
depicted in Fig. 10 since a vertical polygon (faceted) mirror is used. The swaths 
would be horizontal in the event that a galvanometer mirror was selected for the 
vertical movement instead of the vertical polygon mirror. 

5 [0065] Figure 8 also shows a scanning superpixel array 806, which in this 
embodiment is targeted by a set of light emitting devices 60 light emitting devices 
high and 8 light emitting devices wide for each color. Accordingly, for each pass, 
each pixel location is addressed by 8 light emitting devices per primary color. 

[0066] In this embodiment each pixel is targeted 16 times for each frame. For 
10 24-bit color (8 bits each for R, G, and B) there are 256 color levels, so pulse width 
modulation and/or pixel intensity control are used to generate about 16 additional 
color levels to provide full 8-bit color per primary color. 

[0067] In this embodiment each light emitting device should generate 800 
pixels during a single pass, that is, during a single facet of the horizontal scan 

1 5 polygonal mirror. A pass occurs in 1/2400 th of a second, which is about 0.833 
milliseconds. Thus, the rate of generation of pixel illuminations for a single light 
emitting device is 60 Hz x 20 x 800 = 0.96 MHz. Each pixel is generated in about 
one microsecond. Each should generate 16 gray levels, making the least 
significant bit time about 65 nanoseconds if pulse width modulation is used. 

20 Otherwise, the intensity of the light emitting device or a combination of pulse 

width modulation and intensity variation can be used to achieve pixel generation 
at a high rate. Pixel illumination least significant bits could also be generated by 
spatial dithering and/or temporal dithering. This could increase the least 
significant bit time by a factor of about 2 to about 16 depending on what dithering 

25 is done. 

[0068] In this embodiment the most significant bits of pixel illumination are 
split - between different subframes and between different light emitting devices 
targeting a given pixel location - substantially equally 212 as much as possible. 
This helps reduce the effect of missing LEDs and helps reduce flicker. 

30 [0069] Another embodiment similar to that illustrated by Figure 8 (except that 
there would be only 5 scan lines and they would slant - making figure 10 perhaps 
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a closer representation) has the following detailed characteristics: NTSC frame 
rate of approximately 60 Hz; screen resolution of SVGA or 800 x 600; light 
emitting device array 120 tall by 4 wide; two 10-facet mirrors; in a single frame 20 
horizontal passes cover the screen four times, using 20 horizontal facets and 4 
5 vertical facets per frame; horizontal mirror at 7200 RPM, vertical mirror at 1440 
RPM. If we define a subframe as a vertical facet, in this embodiment there are 
four subframes per frame. During a given subframe, each pixel location is 
targeted by four light emitting devices. Thus, the system generates 16 levels (4- 
bits) of color due to the redundancy of coverage. The remaining four bits can be 
10 generated using pulse width modulation and/or intensity variation and/or 
dithering. 

[0070] Some characteristics of these and other embodiments include the 
following. Scanning primary color (such as RGB) light emitting devices generate 
an image. During a single frame, the same pixel location on the screen is 

15 addressed multiple times for a given primary color, providing redundant 
coverage. Redundant coverage may be provided at least in part by having 
multiple light emitting devices simultaneously present for a given line to be 
scanned. Redundant coverage may be provided at least in part by having the 
scanning optics provide multiple passes over the same viewing region; this can 

20 be done using more than one facet of the vertical mirror during a frame, per the 
definition of subframes. Most significant bits can be split between subframes 
(different passes) to help reduce flicker. Redundant coverage may be provided 
by a combination of subframes and redundant light emitting devices. Color levels 
may be generated by a combination of integrated energy applied when a pixel is 

25 generated and multi-pass pixel generation. In some embodiments, the integrated 
energy applied is partly determined by pulse width modulation. In some 
embodiments, the integrated energy applied is partly determined by the intensity 
of the light source. 

[0071] Figure 9 is a diagram illustrating a display with details of a mapping 
30 that maps an array of light emitting devices to target pixel locations in the display 
according to an embodiment of the present invention such as one for an SVGA 
system with four subframes and horizontal swaths. In this embodiment LED light 
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emitting devices are arranged in an array that is 123 LEDs tall (aligned with the 
vertical axis of the display) by 4 LEDs wide (aligned with the horizontal axis). 
Rows of LEDs are numbered for reference from row 1 at the top consecutively 
through row 123 at the bottom. Viewing area rows are numbered for reference 
5 from 1 at the top through row 600 at the bottom. 

[0072] Vertical and horizontal scanning optics are used in this embodiment. 
The vertical mirror is a galvanometer mirror that covers the viewing area in five 
horizontal swaths 902 and covers the entire area four times per frame. Thus, 
there are 20 horizontal swaths per frame. The vertical mirror changes position at 

10 the frequency of 60 x 20 = 1200 Hz. The scanning pattern is to advance one 
swath at a time down the viewing area and then start again at the top. The 
horizontal mirror is a ten-facet mirror spinning at 1200 Hz / 10 = 120 Hz = 7200 
RPM. The galvanometer mirror takes a determinable amount of time to stabilize 
between changes in position. Accordingly, a blanking period is introduced 214 

15 during which the light emitting devices are turned off. This blanking period 
corresponds to regions 904 at each end of the viewing area, and it is 
synchronized with when the light beam(s) from the light emitting devices would hit 
polygonal mirror vertices. 

[0073] During a given frame, the viewing area is targeted by light emitting 
20 devices four times. Each such complete coverage by the light emitting device 
array occurs in a subframe, so there are four subframes per frame in this 
example. The first subframe includes passes (horizontal scans) one through five 
and utilizes light emitting device rows 1-120 while light emitting device rows 121- 
123 are not used during the first subframe. During pass one, light emitting device 
25 rows 1-120 are aligned with viewing area rows 1-120, respectively. On pass 2, 
light emitting device rows 1-120 are aligned with viewing area rows 121-240. On 
pass 3, light emitting device rows 1-120 are aligned with viewing area rows 241- 
360. On pass four, rows 1-120 are aligned with viewing area rows 361-480. On 
pass 5, light emitting device rows 1-120 are aligned with viewing area rows 481- 
30 600. 
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[0074] The second subframe includes passes 6-10 and utilizes light emitting 
device rows 2-121 while light emitting device rows 1, 122, and 123 are not used 
during the second subframe. On pass 6, light emitting device rows 2-121 are 
aligned with viewing area rows 1-120. Note that there may be a small sub-pixel 
5 shift between addressed viewing area rows 1-120 during pass 6 versus pass 1 . 
This may be due to slight variation in alignment accuracy between the pass 6 and 
1 , or it may be a shift intended to allow a resolution enhancement function. But 
for simplicity of the discussion we will refer to pixel locations between subframes 
as being the same. On pass 7, light emitting device rows 2-121 are aligned with 

10 viewing area rows 121-240. On pass 8, light emitting device rows 2-121 are 

aligned with viewing area rows 241-360. On pass 9, light emitting device rows 2- 
121 are aligned with viewing area rows 361-480. On pass 10, light emitting 
device rows 2-121 are aligned with viewing area rows 481-600. Again, note that 
there may be a vertical and/or horizontal sub-pixel shift between the viewing area 

15 pixel locations of passes 1-5 versus passes 6-10. 

[0075] The third subframe includes passes 1 1-15 and utilizes light emitting 
device rows 3-122 while light emitting device rows 1 , 2, and 123 are not used 
during the third subframe. On pass 1 1 , light emitting device rows 3-122 are 
aligned with viewing area rows 1-120. On pass 12, light emitting device rows 3- 

20 122 are aligned with viewing area rows 121-240. On pass 13, light emitting 

device rows 3-122 are aligned with viewing area rows 241-360. On pass 14, light 
emitting device rows 3-122 are aligned with viewing area rows 361-480. On pass 
15, light emitting device rows 3-122 are aligned with viewing area rows 481-600. 
Note that there may be a vertical and/or horizontal sub-pixel shift between the 

25 viewing area pixel locations of passes 6-10 versus passes 11-15. 

[0076] The fourth subframe includes passes 16-20 and utilizes light emitting 
device rows 4-123 while light emitting device rows 1-3 are not used during the 
fourth subframe. On pass 16, light emitting device rows 4-123 are aligned with 
viewing area rows 1-120. On pass 17, light emitting device rows 4-123 are 
30 aligned with viewing area rows 121-240. On pass 18, light emitting device rows 4- 
123 are aligned with viewing area rows 241-360. On pass 19, light emitting 
device rows 4-123 are aligned with viewing area rows 361-480. On pass 20, light 
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emitting device rows 4-123 are aligned with viewing area rows 481-600. Note 
that there may be a vertical and/or horizontal sub-pixel shift between the viewing 
area pixel locations of passes 1 1-15 versus passes 16-20. 

[0077] Some of the characteristics of the example illustrated by Figure 9 thus 
5 include the use of four subframes, horizontal non-overlapping swaths, each pixel 
location being targeted multiple times per frame, each pixel location being 
targeted by multiple light emitting devices during a frame, and each light emitting 
device being directed at multiple pixel locations during a frame. Of particular note 
is that different light emitting device rows are used to target the same viewing 
10 area rows during a frame. For example, viewing area row 1 is targeted by light 
emitting device row 1 during the first subframe, by light emitting device row 2 
during the second subframe, by light emitting device row 3 during the third 
subframe, and by light emitting device row 4 during the fourth subframe. This 
reduces the impact of individually weak or missing light emitting devices. 

15 [0078] Another aspect of the method described with respect to Figure 9 is the 
possibility of introducing some small shift in pixel location between the four 
subframes. This can be utilized to enhance the resolution of the display (for 
example from SVGA to UXGA). Some small amount of shifting of actual location 
will almost always be present due to alignment variations. 

20 [0079] Figure 10 is a diagram illustrating a display with details of a mapping 
that maps an array of light emitting devices to target pixel locations in the display 
according to an embodiment of the present invention such as one for an SVGA 
system with four subframes and diagonal swaths. This embodiment uses four 
subframes and two polygonal mirrors, similar to the embodiment illustrated in c 

25 Figure 9. Light emitting devices are again arranged 123 on the vertical axis by 
four on the horizontal axis, projecting light emitting devices that are spaced at 
screen pixel resolution. The vertical mirror is polygonal with ten facets, spinning 
at (60 Hz x 4)/10 = 24 Hz. The horizontal mirror is polygonal spinning at (60 x 
20)/2 = 120 Hz. Blanking periods are imposed. 

30 [0080] Unlike the previous example, the swaths used in the embodiment 
shown in Figure 10 are diagonal. Swath 1002 corresponds to passes 1, 6, 11, 
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16. Swath 1004 corresponds to passes 2, 7, 12, 17. Swath 1006 corresponds to 
passes 3, 8, 13, 18. Swath 1008 corresponds to passes 4, 9, 14, 19. Swath 
1010 corresponds to passes 5, 10, 15, 20. During subframe 1 passes 1-5 occur. 
During pass 1 , light emitting device rows 1-120 cover a swath that starts at 
5 viewing rows 1-120 at one end of the pass and linearly moves to rows 121-240 at 
the other end of the pass, as depicted in Figure 10. 

[0081] Some of the characteristics of the example illustrated by Figure 10 thus 
include the use of four subframes, diagonal non-overlapping swaths, each pixel 
location being targeted multiple times per frame, and each light emitting device 
10 being directed at multiple pixel locations during a frame. If one advances the light 
emitting device rows being directed, as was done in the example of Figure 9, 
then each pixel location in Figure 10 is also targeted by multiple light emitting 
devices during a frame. 

[0082] Figure 1 1 is a diagram illustrating a display with details of a mapping 
15 that maps an array of light emitting devices to target pixel locations in the display 
according to an embodiment of the present invention such as one for a UXGA 
system with two subframes and diagonal swaths. This embodiment uses two 
subframes and two polygonal mirrors. Light emitting devices are arrayed in 61 
rows on the vertical axis by 8 columns on the horizontal axis. The vertical mirror 
20 has M facets, and spin frequency = (60 Hz x 2)/M. The horizontal mirror has N 
facets, and spin frequency = (60 Hz x 20)/N. Blanking periods are used 214 
corresponding to the regions 904 as shown. In this and other figures relative 
positions are indicated, but the diagrams are not necessarily to scale. The 
correspondence between diagonal swaths and passes in Figure 11 is given by 
25 the following table: 

[0083] 



SWATH 


PASSES 


1102 


1, 11 


1104 


2, 12 


1106 


3, 13 
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1108 


4. 14 


1110 


5, 15 


1112 


6, 16 


1114 


7, 17 


1116 


8, 18 


1118 


9, 19 


1120 


10, 20 



[0084] Some of the characteristics of the example illustrated by Figure 1 1 thus 
include the use of two subframes, diagonal swaths, each pixel location being 
targeted multiple times per frame, and each light emitting device being directed at 
multiple pixel locations during a frame. If one advances the light emitting device 



5 rows being directed, such as by utilizing light emitting device rows 1-60 on 
passes 1-10 and light emitting device rows 2-61 on passes 1 1-20, then each 
pixel location in Figure 10 is also targeted by multiple light emitting devices during 
a frame. 

[00 85] Figure 12 is a table illustrating details of a mapping that maps an array 
10 of light emitting devices to target pixel locations in a display according to an 

embodiment of the present invention such as one for an SVGA system with ten 
subframes and stripes from interleaving light emitting devices. Light emitting 
devices are arranged in an array 121 tall by 4 wide per color, with their 
associated dots spread out over the entire viewing surface in stripes during 
1 5 operation. The vertical mirror is a galvanometer mirror having a frequency of (60 
Hz x 10) = 600 Hz. The horizontal mirror is polygonal with N facets, for 10 
passes per frame, and spin frequency = (60 revolutions per second x 10)/N. 
Blanking periods are used 214 at polygon vertices to allow for galvanometer 
mirror movement and settling. The light emitting devices generate dots that scan 
20 across the viewing surface 10 times in a frame, so there are 10 subframes per 
frame. The correspondence between stripes and passes is given by the table in 
Figure 12. 
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[0086] Some of the characteristics of the example illustrated by Figure 12 thus 
include the use often subframes, horizontal stripes, each pixel location being 
targeted multiple times per frame, each light emitting device being directed at 
multiple pixel locations during a frame, and each pixel location being targeted by 
5 multiple light emitting devices during a frame. 

[0087] Figure 13 is a table illustrating details of a mapping that maps an array 
of light emitting devices to target pixel locations in a display according to an 
embodiment of the present invention such as one for a UXGA system with ten 
subframes and stripes from interleaving LEDs. This embodiment uses ten 

10 subframes and two mirrors for inducing scanning of spots across a viewing 
surface. Light emitting devices are arranged in an array 120 tall by 4 wide per 
color, spread out over the entire viewing surface in stripes. The vertical mirror is 
a small deflection galvanometer mirror twitching at (60 Hz x 10) = 600 Hz. The 
horizontal mirror is polygonal with N facets, for 10 passes per frame, and spin 

15 frequency = (60 revolutions per second x 10)/N. Blanking periods may be used 
214 at polygon vertices to allow for galvanometer mirror movement and settling. 
The light emitting device spots scan across the viewing surface 10 times in a 
frame, so there are 10 subframes per frame; each subframe covers 10% of the 
pixel locations. The correspondence between stripes and passes is given by the 

20 table in Figure 13. Each pixel location is addressed once by each beam or four 
times (for the four beams) during a single frame. 

[0088] Some of the characteristics of the example illustrated by Figure 13 thus 
include the use often subframes, horizontal stripes, each pixel location is a light 
emitting device target at least twice per frame, and each light emitting device is 
25 directed toward at least two pixel locations per frame. 

Conclusion 

[008 9] Although particular embodiments of the present invention are expressly 
illustrated and described herein as methods or devices, it will be appreciated that 
30 discussion of one type of embodiment also generally extends to other 

embodiment types. For instance, the descriptions of projection methods also 
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help describe projection system components and projection systems. It does not 
follow that limitations from one embodiment are necessarily read into another. 

[0090] Headings are for convenience only; information on a given topic may 
be found outside the section whose heading indicates that topic. All claims as 
5 filed are part of the specification and thus help describe the invention, and 
repeated claim language may be inserted outside the claims as needed. 

[0091] It is to be understood that the above-referenced embodiments are 
illustrative of the application for the principles of the present invention. Numerous 
modifications and alternative embodiments can be devised without departing 
10 from the spirit and scope of the present invention. While the present invention 
has been shown in the drawings and described above in connection with the 
exemplary embodiments of the invention, it will be apparent to those of ordinary 
skill in the art that numerous modifications can be made without departing from 
the principles and concepts of the invention as set forth in the claims. 

15 [0092] As used herein, terms such as "a" and "the" and designations such as 
"light emitting device" and "directing" are inclusive of one or more of the indicated 
item or step. In particular, in the claims a reference to an item generally means 
at least one such item is present and a reference to a step means at least one 
instance of the step is performed. 

20 [0093] The scope of the invention is indicated by the appended claims rather 
than by the foregoing description. All changes which come within the meaning 
and range of equivalency of the claims are to be embraced within their scope to 
the full extent permitted by law. 



